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(54) Method and system for generating document summaries with navigation information 



(57) A method and a system for generating a docu- 
ment summary. The method and the system extract text 
along with corresponding position information from a 



document, provide the extracted text to a document 
summarizer (62) and generates a summary with indica- 
tors that indicate the corresponding locations in the doc- 
ument from which the summary portions were extracted. 
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D scription 

[0001] This invention relates to a method and a sys- 
tem for automatic text processing. In particular, this in- 
vention relates to a method and system for generating 
a document summary with document navigation infor- 
mation. 

[0002] Automatically generated document summa- 
ries serve a valuable function by reducing the time re- 
quired to review documents. Conventional summaries, 
while providing a good indication of the total content of 
the summarized document, do not provide any means 
for accessing the content of the document. Therefore, if 
a reader is particularly interested in a certain portion of 
the summary, the reader is forced to scan the text of the 
entire documenfto locate the portions of the document 
that correspond to points of interest in the summary. 
There exists a need for assisting a reader in locating 
portions of a document that correspond to portions of 
the summary. 

[0003] In accordance with one aspect of the present 
invention, a method for summarizing a document com- 
prises: 

extracting text from the document along with corre- 
sponding location information; 
identifying portions of the extracted text that reflect 
the content of the document; 
generating a presentation file that includes the iden- 
tified portions and a first set of indicators that indi- 
cate the locations of the corresponding extracted 
text in the document: and 
presenting the presentation file. 

[0004] Preferably, the method further comprises for- 
matting the layout of a presentation file that includes the 
identified portions and a first set of indicators that indi- 
cate the locations of the corresponding extracted text in 
the document 

[0005] In accordance with a second aspect of the 
present invention, an automatic document summarizer 
comprises: 



[0006] This invention generates a summary page that 
includes indicators that help th user find the corre- 
sponding place in the summarized document from 
which the summary information was extracted or to 

5 which the summary information is most related. This in- 
vention enables the user to navigate from the summary 
to the related locations in the document. This invention 
also highlights the portions of the document that have 
been extracted for the summary. 

w [0007] This invention connects the summary informa- 
tion with the contents of the summarized document by 
adding location information and/or navigation informa- 
tion to the summary. The method and the system of this 
invention work with conventional image or text docu- 

'5 ment summarization systems, by preserving the location 
information of the content that is extracted from a doc- 
ument and by generating a summary with indicators that 
indicate the corresponding locations in the document 
from which each portion of the summary was extracted. 

20 in one embodiment, these indicators indicate page and 
line numbers and have matching indicators within the 
summarized document. 

[0008] This invention prepares a file from the docu- 
ment for input into a conventional document summariz- 
es er, receives the output from the automatic document 
summarizer and conditions the output to provide indica- 
tors to the output summary and document. 
[0009] The indicators of this invention enable the user 
to quickly access the corresponding portions of the doc- 
30 ument that are related to the summary by directly ac- 
cessing the document using the information indicated 
by the indicator or by locating a matching indicator within 
the outputted document. This task is made easier by 
highlighting the extracted portions within the outputted 
3S document. 

[0010] This invention uses an automatic summarizer, 
linked to a device that can identify the page image and 
page location in the original document where the sum- 
mary material is located. The location information is 
40 generated by a conventional or modified text or image 
summarizer. In image summarization, a page number 
can be found by applying image matching methods. In 
the case of text summarization, conventional printing 
software can be modified such that the page numbers 
assigned by it are made known to the software imple- 
menting the present invention. 

[0011] The preferred embodiments of this invention 
will be described in detail, with reference to the following 
figures, wherein: 

Fig. 1 is a block diagram of one embodiment of the 
document summarizer of this invention; 
Figs. 2A-2B show a flowchart outlining the control 
routine of one embodiment of this invention; 
Fig. 3 is a block diagram of on embodiment of a 
processor of this invention. 

Fig. 4 is a sample summary generated by one em- 
bodiment of this invention; and 



a processor that comprises: 

a text extractor that extracts text from a document 45 
along with corresponding extracted text location in- 
formation; 

a document summarizer that identifies portions of 
the extracted text that reflect the content of the doc- 
ument; and 50 
a presentation file formatter that formats the layout 
of a presentation file that includes the identified por- 
tions and a first set of indicators that indicate the 
locations of the corresponding extracted text in the 
document; and ss 
a presentation syst m that presents the pres nta- 
tion file. 



J S DOC ID; <EP 093371 2A2_I_> 



2 



3 



EP0 933 712 A2 



4 



Fig. 5 shows the source document that was ana- 
lyzed to produce the summary of Fig. 4. 

[0012] Fig. 1 shows a block diagram of one embodi- 
ment of the document summarizer 10 of this invention. 
The document summarizer 10 includes a processor 12 
communicating with a memory 14 and a hard drive 16. 
The processor 12 also communicates through an input/ 
output interface 18 to any number of conventional input/ 
output devices such as a pen 20, a mouse 22, a key- 
board 24, a display 26, an optical character recognition 
system, a printer 30, and a scanner 32. The input/output 
devices 20-32 are operated by a user to control the op- 
eration of the document summarizer 10. The processor 
1 2 also communicates throughlink 34 to an external da- 
ta source 38. The link 34 includes an interruptible con- 
nection 36. 

[001 3] As shown in Fig. 1 , the system 1 0 is preferably 
implemented using a programmed general purpose 
computer. However, the system can be implemented us- 
ing a special purpose computer, a programmed micro- 
processor or microcontroller and any necessary periph- 
eral integrated circuit elements, an ASIC or other inte- 
grated circuit, a hardwired electronic logic circuit such 
as a discrete element circuit, a programmable logic de- 
vice such as a PLD, PLA, FPGA, or PAL, or the like. In 
general, any device on which a finite state machine ca- 
pable of implementing the flowcharts shown in Figs. 2 A 
and 2B can be used to implement the system 10. 
[0014] Additionally, as shown in Fig. 1, the memory 
14 is preferably implemented using static or dynamic 
RAM. However, the memory 14 can also be implement- 
ed using a floppy disk and disk drive, a writeable optical 
disk and disk drive, a hard drive, flash memory, or the 
like. Additionally, it should be appreciated that the mem- 
ory 14 can be a distinct portion of a single memory or 
physically distinct memories. 

[0015] Further, it should be appreciated that the link 
34 connecting the microprocessor 1 2 to the external da- 
ta source 38 can be a wired or a wireless link to a net- 
work (not shown). The network can be a local area net- 
work: a wide area network, an intranet, the Internet, or 
any other distributed processing and storage network. 
In this case, a document may be downloaded from an 
external data source 38 for processing by the system 
10 according to the method outlined below. 
[0016] Figs. 2 A and 2B show a flowchart outlining the 
control routine of one embodiment of the method of this 
invention. Beginning in step 1 00, the control routine con- 
tinues to step S110 where a document is input into the 
system 10. In step S120, the control routine determines 
whether the document is summarizable. If the document 
is not summarizable, the control routine continues to 
step S1 30. In step S1 30, the control routine prints a "ge- 
neric" cover sheet and continu s to step S1 40. Th "ge- 
neric" cover sheet may include any type of information 
that may not be related to the input document. In step 
S140, the document is printed and the control routine 



continues to step S150 where the control routine stops. 
[0017] If in step S120, the control routine determines 
that the document is summarizable, the control routine 
jumps to step S160. In step S140, the control routine 
s determines if the document is of a special type that re- 
quires or may benefit from special processing. A docu- 
ment of a special type may be identified by a user. An 
example of a special type includes a group of e-mail 
messages that each have a summary field. This exam- 
ple will be explained in more detail below. 
[0018] If the document is in a special format, the con- 
trol routine continues to step S170. However, if the con- 
trol routine determines that the document is not in a spe- 
cial format, the control routine jumps to step S170. In 
step.S150, the control routine extracts the summary in- 
formation in accordance with the special processing and 
jumps to step S270. 

[0019] In step S180, the control routine identifies the 
format of the document and continues to step S190. In 
step St 90, the control routine generates a printable file 
from the input document. This printable file is necessary 
to generate layout information which will be used in sub- 
sequent steps. The control routine then continues to 
step S200 where the control routine extracts text from 
the printable file and creates another file that is suitable 
for processing by a summarizer. Then the control routine 
continues to step S21 0 where the control routine creates 
a layout file having position information on the printable 
file created in step S190 and corresponding pointers to 
the extracted text file created in step S200. The control 
routine then continues to step S220, where the control 
routine analyzes the extracted text file to determine 
which portions of text will be included in the summary. 
The control routine may use a conventional or modified 
text summarizer. The control routine then continuesto 
step S230 where the control routine generates a print- 
able output file by concatenating the summary text in 
the printable file created in step S190. Preferably, the 
summary is placed in the output file before the original 
document in a cover page. The control routine then con- 
tinues to step S240. In step S240, the control routine 
modifies the output file by attaching indicators that indi- 
cate the location of the portions of the summary in the 
original document. The indicators are created by refer- 
ring to the extracted text file and to the layout file. The 
control routine then continues to step S250 where the 
output file is modified to place the indicators in the mar- 
gin of the cover page. The control routine then continues 
to step S260. 

[0020] In step S260, the control routine modifies the 
output file by adding additional indicators that are posi- 
tioned adjacent to the portions of the document that cor- 
respond to portions of the summary. The control routine 
also highlights the indicated portions of the document in 
step S260. The control routine then continu s to step 
S270. In step S270, the control routine s nds the output 
file to a printer to print the document and then continues 
to step S280 where the control routine stops. 
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[0021] If the input document.is identified as requiring 
special processing in step S160 then the control routine 
continues to step S1 70. In step S170, the control routine 
generates an output file that has a summary page with 
indicators that indicate from where each portion of the 
summary originated in the input document. The inten- 
tion of steps Si 60 and S 1 70 are to make clear that one 
of ordinary skill in the art would know that steps 
S1 80-S260 can be modified in accordance with the input 
document type and still form a part of the invention. 
[0022] One example of an input file that could benefit 
from special processing is a document that includes 
several e-mail messages that each have a "subject" 
field. The control routine recognizes that such a docu- 
ment requires or can benefit from special- processing. 
Alternatively, a user can identify the input document as 
requiring special processing to the control routine with 
a user interface (not shown). In this example, the 
processing would take advantage of the knowledge that 
there are predefined "subject" fields and will generate a 
summary from these "subject" fields and thereby obvi- 
ate the necessity of performing a text summarization 
process on the document. The summary would include 
the text from each "subject" field along with indicators 
that indicate the position in the output file where each 
portion of the summary may be found. 
[0023] A specific example of the operation of this in- 
vention will now be described while referring to the flow- 
charts of Figs. 2A and 2B. The source document in this 
example is a PostScript file. PostScript is a page-de- 
scription language from Adobe Systems, Inc. that offers 
flexible font capability and high-quality graphics. Post- 
Script uses English-like commands to control page lay- 
out and to load and scale outline fonts. A page descrip- 
tion language describes output to a printer or a display 
device using instructions from the page-description lan- 
guage to construct text and graphics and to, thereby, 
create the required page image. 
[0024] Processing of the PostScript file starts at step 
S100 and continues to step S110 where the file is input 
to the system. The control routine continues to step 
S1 20 where the control routine determines that the doc- 
ument is summarizable and then continues to step S1 60 
where the control routine determines that the PostScript 
file is not one of a predetermined special type. 
[0025] The control routine continues to step SI 80 
where the format of the input document is identified as 
PostScript. The control routine continues to step 190 
where the control routine generates a printable output 
file. In this example, because the PostScript file is al- 
ready printable, the control routine merely makes a copy 
of the input document as the printable output file. There- 
fore, the printable output file is also a PostScript file. The 
control routine then continues to step S200 where the 
text is xtracted from the printable file. The control rou- 
tine continues to step S200 where the control routine 
extracts the text using a modified PostScript interpreter 
and a text extraction program. In step S200, the Post- 



Script int rpreter analyzes th PostScript file and gen- 
erates an ASCII file that includes position information. 
The invention then utilizes a text extraction program. 
The text extraction program maps font differences, an- 

5 alyzes the stream of characters, and picks out words, 
lines, and paragraphs. The text extraction program also 
records the location information in accordance with the 
identified, extracted text. The control routine then con- 
tinues to step S210. In step S210 the control routine 

10 generates a layout file and continues to step S220. 
[0026] In step S220, the system analyzes the ASCII 
file using text summarizer to determine what portions of 
the extracted text are to be included in the summary. 
The control routine then continues to step S230 where 

1$ - a PostScript generator creates a printable output file. In 
step S230, the output file is created using the summa- 
rized text from step S220 and the position information 
corresponding to the summarized text from the layout 
file created in step S210. The control routine then con- 

20 tinues to step S240. In step S240, the control routine 
modifies the output PostScript file with instructions that 
add indicators to the summary. The control routine then 
continues to step S250. In step S250, the control routine 
appends the output PostScript file with instructions that 

2S add indicators to the margin of the cover page. The con- 
trol routine then continues to step S260. 
[0027] In step S260, the control routine modifies the 
output PostScript file to highlight those portions of the 
document that correspond to the portions of the sum- 

30 many. The control routine then continues to step S270 
where the control routine sends the output PostScript 
file to a printer and then continues to step S280 where 
the control routine stops. 

[0028] It should be appreciated that while the inven- 
ts tion has been described above in connection with Post- 
Script and ASCII text files that this invention may be 
used in conjunction with any type of document format 
including, for example, any type of graphic, audio : and 
video document formats. 
40 [0029] It should also be appreciated that steps S21 0, 
S220 and S240 are all optional and that the indicators 
may take whatever form is appropriate for the desired 
style of output. The indicators only need to provide a 
reference to the document content by providing position 
45 information or as an indicator to be matched with anoth- 
er indicator within the document. 
[0030] Additionally, while the embodiment of the con- 
trol routine described above and in Figs. 2A and 2B gen- 
erates a single output file, one of ordinary skill under- 
go stands that the control routine may generate any 
number of output files such as, for example, a first output 
file having only the cover page with a summary and a 
second output file having only the document. 
[0031] Typical document summarizers present the 
55 s nt nces in the summary in th same order that the 
s ntences are encountered in th summarized docu- 
ment. How ver, these sentences may not be in the 
same order in the summary as they appear in the related 
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document. In that case, the indicators may be presented 
in the summary in the order that the summary presents 
the sentences or in the order in which the sentences ap- 
pear in the related document. If the indicators are to ap- 
pear on the summary page in the order that the sentenc- 
es appear in the related document, then leaders may be 
provided from the indicators to each of the correspond- 
ing portions of the summary. 

[0032] The output of the summarized document may 
not facilitate easy positioning of indicators to readily in- 
dicate which portions of the summarized document cor- 
respond to the indicator. Therefore, leaders may also be 
added from the indicators in the summarized document 
to the portions of the summarized document that have 
been extracted for the summary. 
[0033] The indicators may be placed on the summary 
page in a vertical position on the margin that corre- 
sponds to the vertical position of the corresponding por- 
tions of the summarized document. Such an arrange- 
ment makes it easier for a user to find an indicator within 
the summarized document when flipping through a doc- 
ument. Indicators in the summarized document may be 
eliminated very quickly when the vertical position does 
not match the vertical position of the indicator in the 
summary sheet. On the other hand, an indicatorthat has 
a vertical position that matches the vertical position of 
the corresponding indicator in the summary sheet can 
quickly indicate the correspondence between the two in- 
dicators to the user of the document 
[0034] Additionally, this invention also provides indi- 
cators to a list of keywords. Conventional document cat- 
aloging systems generate a list of keywords that may 
be quickly searched to locate a document related to the 
keyword. This invention is also useful with a keyword 
list generating system to provide indicators adjacent the 
keywords to indicate the location of the keywords within 
the summarized document. 

[0035] The indicators may also take the form of a 
background color or font color on a portion of the docu- 
ment summary. In this case, a matching indicator in the 
summarized document is highlighted using a back- 
ground or font color that matches the corresponding por- 
tion of the summary. The indicators may also take the 
form of character attributes such as Bold or Italics. In 
this case, for example, a portion of the summary may 
be bold while another portion is italicized. The corre- 
spondence to the original document would be indicated 
because the source text would have a corresponding 
character attribute. It is to be understood that the indi- 
cators may take any form that allows one to distinguish 
between indicators and also indicates the correspond- 
ence of each portion of the summary to the source in 
the underlying original document. 
[0036] Fig. 3 shows a block diagram of one embodi- 
ment of the processor 12 of this invention. The proc s- 
sor 12 is preferably implemented using a general pur- 
pose computer 50. The general purpose computer 50 
preferably includes a controller 52, a memory 54. a doc- 



ument type identifier 56, a document interpreter 58, a 
text extractor 60, a document summarizer 62, an output 
formatter 64, and a bus 66. The elements of the general 
purpose computer 50 are interconnected by the bus 66. 
5 The document type identifier 56, the document interpret- 
er 58, the text extractor 60, the document summarizer 
62, and the output formatter 64 are used to implement 
the flowchart of Figs. 2A and 2B. It should be appreci- 
ated that the document type identifier 56, the document 
interpreter 58, the text extractor 60, the document sum- 
marizer 62, and the output formatter 64 are preferably 
implemented as software routines running on the con- 
troller 52 and stored in the memory 54. It should also be 
appreciated that many other implementations of these 
.elements will be apparent to those skilled in the.art. 
[0037] It should be understood that the term "docu- 
ment" is intended to include text, audio, video, or any 
other information storing file in any combination of infor- 
mation storing files. Further, it should be understood that 
the term "text* is intended to include text, digital ink, au- 
dio, audio bars, video, or any other content of a docu- 
ment, including a document's structure. It should also 
be appreciated that the term "display" is intended to in- 
clude any type of presentation device appropriate for the 
type of text in the document. It should be further under- 
stood that the term "portion" is intended to include any 
divisible structure of a document such as, for example, 
words, sentences, phrases, paragraphs, sections, pag- 
es, and any other distinguishable portion of a document. 
Structural information designates divisible portions of 
documents. 

[0038] Fig. 4 shows a sample output of one embodi- 
ment of this invention. Fig. 5 shows the source docu- 
ment 70 which has been summarized. 
[0039] A summary sheet 72 includes a header 74 and 
a summary 76. The summary sheet 72 also includes the 
title of the summarized document 78 adjacent to an ex- 
tracted portion of the document 80 that generally reflects 
the overall content of the document. The summary 76 
includes extracted portions 82 which reflect the content 
of portions of the summarized document 70 and a list of 
keywords 38. Indicators 84 have been placed adjacent 
to the corresponding extracted portions 82. These indi- 
cators 84 have corresponding tabs 86 positioned on the 
margin of the summary sheet 72. The tabs 86 indicate 
the vertical position of the extracted portion in the sum- 
marized document 70 that correspond to the indicators 
84. In this example, the summarized document has not 
been output with indicators or tags that correspond to 
the indicators 84 and tags 86 of the summary sheet. It 
should be appreciated that other embodiments of this 
invention may provide indicators and tabs in the output 
of the summarized document 70. 
[0040] While the above explanation and description 
has gen rally ref rr d to position and location informa- 
tion, it is to be understood that th indicators of this in- 
vention includ valuable navigation information as a re- 
sult of the fact that the indicators include position infor- 
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mation. Therefore, th indicators include navigation in- 
formation which is helpful to a user to navigate a docu- 
ment to locate the position in a document from which a 
particular portion of summary originated. 



Claims 

1 . A method for summarizing a document, the method 
comprising: 

extracting text from the document along with 
corresponding location information; 
identifying portions of the extracted text that re- 

-fleet the content of the document; 

generating a presentation file that includes the 
identified portions and a first set of indicators 
that indicate the locations of the corresponding 
extracted text in the document; and 
presenting the presentation file. 

2. The method of claim 1 , where the location informa- 
tion comprises structural information. 

3. The method of claim 1 or claim 2, where the location 
information comprises layout information. 

4. The method of any of claims 1 to 3, further compris- 
ing the step of identifying the document as being of 
a predetermined type, wherein the steps of extract- 
ing and identifying correspond to the predetermined 
type. 

5. The method of any of claims 1 to 4, further compris- 
ing: 

generating a second set of indicators that cor- 
respond to the first set of indicators; and 
placing the second set of indicators in the lay- 
out of the document adjacent to the corre- 
sponding extracted text, wherein the first set of 
indicators comprise presenting each corre- 
sponding portion of summary in a presentation 
attribute that corresponds to the second set of 
indicators that comprise the presentation of the 
corresponding extracted text of the document 
in the same corresponding presentation at- 
tribute. 

6. An automatic document summarizer comprising: 

a processor that comprises: 
a text extractor that extracts text from a docu- 
ment along with corresponding extracted text 
location information; 

a document summariz r that identifies portions 
of the extracted t xt that reflect the content of 
the docum nt; and 



a presentation file formatter that formats the 
layout of a presentation fil that includes the 
identified portions and a first set of indicators 
that indicate the locations of the corresponding 
5 extracted text in the document; and 

a presentation system that presents the pres- 
entation file. 

7. The summarizer of claim 6 ; where the location in- 
w formation comprises structural information. 

8. The summarizer of claim 6 or claim 7, where the 
location information comprises layout information. 

*5 9. The summarizer of any of claims 6 to8, wherein the 
processor further comprises a document type iden- 
tifier that identifies the document as being of a pre- 
determined type, wherein the text extractor extracts 
the text using a method corresponding to the iden- 

20 tified predetermined type and the document sum- 
marizer identifies portions using a method corre- 
sponding to the identified predetermined type. 

10. The summarizer of any of claims 6 to 9, where the 
2S presentation file formatter generates a second set 
of indicators that correspond to the first set of indi- 
cators and places the second set of indicators in the 
layout of the document adjacent to the correspond- 
ing extracted text, wherein the first set of indicators 
30 comprise presenting each corresponding portion of 
summary in a presentation attribute that corre- 
sponds to the second set of indicators that comprise 
the presentation of the corresponding extracted text 
of the document in the same corresponding pres- 
35 entation attribute. 
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Text Of Remarks By RNC Chairman Halev Barbour 
My name's Haley Barbour, and we are all pan of the 
American family. 

A \Ve are the Republics* Party - a big. broad, diverse and inclusive party. 

with a common-sense agenda aad a better man for a better America. 
2n Bob Dole. 

o Thank you. ladies and gentlemen for being part of this quest in working 
with ua to restore tbe American Dream. 

What we re doing here this week is celebrating Republican ideas and 
achievements, the ideu sod achievements that represent the first step 
io our campaign to restore the American dream of more and better 
04 job** of smaller, smarter government: of stronger families and a return 



to traditional values. 



These common-sense Republican proposals are the first step in restoring 
£)4 the American dream because Republicans care about America. 

And under the leadership of President Bob Dole, we Republicans can and / 
will restore the American Dream. / 
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T«xc Of Remark* By RNC Chairoan Haley Barbour 

wy qam's ha lay terbour, aad we are all part of 
the Aaaricaa family. And we All believe we can 
restore the American Dream. 

we are the Republican Party — a bio. broad, 
diverse aad_ inclusive party, with a catmon-amswm 
agenda aad a better man tor a better America. 
Sob Do la. 

Thank you. ladies aad gsacloastt Cor being part 
of this quMt 10 working with us to rastora tha 
Aaaricaa Draaa. 

I'd like co wale on* you delegatee aad guests to 
the 1996 Republican National Convention. Whac 
we're do log bare this weak is ceiebratiag; 
Republican idaas aad acbiavaaaflta . tha idaaa aad 
achievsesmcs that raprasaat tha first stop ia 
our campaign to rasters tha Aaaricaa dream of 
mora aad battar jobs; of ssallor. smarter 
government; of itronger families and a racurn to 
traditional values. 

we're hare to talk aad to listaa to our 
dalaoataa aad to Aaarica about tha common-seaoa 
proposals that ara right for our families, for 
our eownitias , aad for our country. 

Thasa common- sense Republican proposals ara tha 
first stap ia rsstoriag tha imsricaa draaa 
bacauaa ftepublicaas car a about America. 

wa cars about workiao paopla. That's why wa want 
than to earn more for chair work aad gat to ksap 
mora of «mat thay aarn. 

wa cars about families, aad that's why wa want 
to cut chair taxee aad gat government out of 
chair llvsa so they can aaka thair own daclaloaa 
about what's right for choir children. 

wa cars about caller so. That's why wa want to 
wia tha war on drug* aad not just run up tha 
whita flag. 

wa cars about paopla on walfara. That's why wo 
want to gat them off walfara and back on tha 
road that laada thaa to a battar lifa for 
themselves aad for thair kids. For tha kids of 
walfara familias ara tha rows of tha libaral war 
oa poverty. 

That's all part of restoring tha Aiaaricaa areas), 
and under tha leadership of President Bob Dole-, 
wa Republicans can and will restore the Aaaricaa 
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